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AMENDMENTS TO THE CLAIMS 

1. (canceled) 

2. (currently amended) The m e thod of claim L A method of video encoding or 
decoding including merging segments to form supersegments in an image, wherein said 
image consists of a plurality of segments that are constituent portions of the image, the 
method of video encoding or decoding comprising: 

identifying at least one candidate segment(s); 

identifying at least one neighboring segmentrs") for each candidate segment; 

computing an error statistic for each pain wherein each pair consists of a 
candidate segment and a corresponding neighboring segment: 

determining a neighboring segment that results in a smallest error statistic for a 
given candidate segment: 

determining whether said smallest error statistic is sufficiently small so as to be 
less than a threshold value so as to merit merging of the corresponding pair of segments: 
and 

merging said corresponding pair of segments to create one supersegment if said 
smallest error statistic is less than the threshold value, wherein a supersegment is a new 
segment comprising all pixels formerly contained in one of the two segments that were 
merged, 

wherein said error statistic is computed using one or more merging parameters 
selected from the group consisting of a difference in mean color between the two 
segments, a difference in color variance between the two segments, a measure of a color 
gradient along a common boundary between the two segments, a length of the common 
boundary, a total boundary length of a boundary of the candidate segment, an area of the 
candidate segment, and an area of the neighboring segment. 

3. (currently amended) The method of claim 1 claim 2, wherein the error statistic for 
a pair consisting of a candidate segment and a neighboring segment is set above the 
threshold value if the common boundary between the segments is smaller than a cutoff 
percentage of the total boundary length of the candidate segment. 
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4. (currently amended) The method of claim 1 > A method of video encoding or 
decoding including merging segments to form supersegments in an image, wherein said 
image consists of a plurality of segments that are constituent portions of the image, the 
method of video encoding or decoding comprising: 

identifying at least one candidate segment(s); 

identifying at least one neighboring segmentrs't for each candidate segment: 

computing an error statistic for each pain wherein each pair consists of a 
candidate segment and a corresponding neighboring segment: 

determining a neighboring segment that results in a smallest error statistic for a 
given candidate segment: 

determining whether said smallest error statistic is sufficiently small so as to be 
less than a threshold value so as to merit merging of the corresponding pair of segments: 
and 

merging said corresponding pair of segments to create one supersegment if said 
smallest error statistic is less than the threshold value, wherein a supersegment is a new 
segment comprising all pixels formerly contained in one of the two segments that were 
merged. 

wherein the error statistic for a pair consisting of a candidate segment and a 
neighboring segment is set above the threshold value if the area of the neighboring 
segment is smaller than the area of the candidate segment. 

5. (currently amended) The method of claim 1 claim 2 . wherein the threshold value 
varies according to the [[size]] area of the candidate segment. 

6. (currently amended) Th e m e thod of claim L furth e r comprising A method of 

merging segments to form supersegments in an image, wherein said image consists of a 
plurality of segments that are constituent portions of the image, the method comprising: 
identifying at least one candidate segment(s): 

identifying at least one neighboring segments s) for each candidate segment: 
computing an error statistic for each pair, wherein each pair consists of a 
candidate segment and a corresponding neighboring segment: 
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determining a neighboring segment that results in a smallest error statistic for a 
given candidate segment: 

determining whether said smallest error statistic is sufficiently small to merit 
merging of the corresponding pair of segments; 

merging said corresponding pair of segments to create one supersegment if said 
smallest error statistic is sufficiently small to merit said merging, wherein a supersegment 
is a new segment comprising all pixels formerly contained in one of the two segments 
that were merged: and 

using a tiebreak criterion in the case when more than one neighboring segment is 
sufficiently close to the minimum error statistic, said tiebreak criterion selecting the one 
of said neighboring segments that has smallest area. 

7. (currently amended) The method of claim 1 claim 2. wherein multiple 
neighboring segments are merged with a candidate segment wherein each of the 
neighboring segment's error statistic is below the threshold value. 

8. (currently amended) Tho method of claim 1, A method of video encoding or 
decoding including merging segments to form supersegments in an image, wherein said 
image consists of a plurality of segments that are constituent portions of the image, the 
method of video encoding or decoding comprising: 

identifying at least one candidate segment(s); 

identifying at least one neighboring segment(s) for each candidate segment: 

computing an error statistic for each pair, wherein each pair consists of a 
candidate segment and a corresponding neighboring segment: 

determining a neighboring segment that results in a smallest error statistic for a 
given candidate segment: 

determining whether said smallest error statistic is sufficiently small so as to be 
less than a threshold value so as to merit merging of the corresponding pair of segments: 
and 

merging said corresponding pair of segments to create one supersegment if said 
smallest error statistic is less than the threshold value, wherein a supersegment is a new 
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segment comprising all pixels formerly contained in one of the two segments that were 
merged. 

wherein the error statistic E for a pair of segments is computed according to the 
formula E = Ac 'AG, wherein AG is a measure of the gradient along the boundary 
between the segments and Ac is a measure of the difference in mean color and color 
variance between the segments. 

9. (original) The method of claim 8, wherein: 

Ac = Amy Avy + Aniu Avu + Arriv Avy, wherein Am is a measure of the difference 
between the mean intensity values for the candidate and neighboring segments, wherein 
Av is a measure of the difference between the variances of intensity values for the 
candidate and neighboring segments, and wherein the subscripts;/, w, v denote the Y, U, 
and V color components, respectively; 

G = Wygy-^ Wugu-^ gv, whcrcin each of gy, gw and gv are local color gradients 
(in the Y, U, and V color components) at a single boundary edge and Wy, Wu, and Wy are 
weights; and 

AG is found by taking the medians of the G values at every n consecutive edges 
of the common boundary and then takmg the mean of this collection of median values. 

10. (currently amended) The method of claim 1 claim 2 , wherein one or more of th e 
m e rging param e t e rs ar e said error statistic is calculated in a neighborhood of the common 
boundary between the candidate segment and the neighboring segment. 

1 1 . (original) The method of claim 10, wherein said neighborhood of the common 
boundary consists of a fixed number of pixels on either side of and perpendicular to each 
boundary edge. 

12. (currently amended) The method of claim 10, wherein said m e rging param e t e rs 
error statistics are calculated during a raster-scan through an array of pixels and stored in 
a table, and wherein said m e rging param e t e rs error statistics are updated whenever two or 
more segments are merged to form a supersegment to correct the values for the new 
supersegment and its neighboring segments. 
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whereby merging decisions for a plurality of candidate segments may be made by 
referring to the data contained in said table. 

13. (currently amended) Tho mothod of claim 1 A method of merging segments to 
form supersegments in an image, wherein said image consists of a plurality of segments 
that are constituent portions of the image, the method comprising: 

identifying at least one candidate segmentfs): 

identifying at least one neighboring segment(s) for each candidate segment: 

computing an error statistic for each pain wherein each pair consists of a 
candidate segment and a corresponding neighboring segment: 

determining a neighboring segment that results in a smallest error statistic for a 
given candidate segment: 

determining whether said smallest error statistic is sufficiently small to merit 
merging of the corresponding pair of segments: and 

merging said corresponding pair of segments to create one supersegment if said 
smallest error statistic is sufficiently small to merit said merging, wherein a supersegment 
is a new segment comprising all pixels formerly contained in one of the two segments 
that were merged. 

wherein one or mor e of th e m e rging param e t e rs ar e said error statistic is 
calculated using only the pixels in the neighboring segment which lie within an extended 
bounded box around the candidate segment. 

14. (currently amended) An apparatus for video encoding or decoding including 
means for merging segments to form supersegments in an image, wherein said image 
consists of a plurality of segments that are constituent portions of the image, the 
apparatus being configur e d to: comprising: means to identify at least one candidate 
segment(s); means to identify at least one neighboring segment(s) for each candidate 
segment; means to compute an error statistic for each pair, wherein each pair consists of a 
candidate segment and a corresponding neighboring segment; means to determine a 
neighboring segment that results in a smallest error statistic for a given candidate 
segment; means to determine whether said smallest error statistic is sufficiently small to 
merit merging of the corresponding pair of segments; and means to merge said 
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corresponding pair of segments to create one supersegment if said smallest error statistic 
is sufficiently small to merit said merging, wherein a supersegment is a new segment 
comprising all pixels formerly contained in one of the two segments that were merged ^ 
and wherein said error statistic is computed using one or more merging parameters 
selected from the group consisting of a difference in mean color between the two 
segments, a difference in color variance between the two segments, a measure of a color 
gradient along a common boundary between the two segments, a length of the conmion 
boundary, a total length of a boundary of the candidate segment, an area of the candidate 
segment, and an area of the neighboring segment . 

15. (original) The apparatus of claim 14, wherein the apparatus is embodied in a 
computer that includes a CPU and memory and a specifically-designed application 
program. 

16. (original) The apparatus of claim 14, wherein the apparatus is embodied in a 
specifically-designed hardware device, including both processing and memory circuitry. 
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